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Exec 3 Overview 



Purpose 

The purpose of the Exec3 program is to efficiently test products. Here, 
evaluated over many phases of a product life cycle: test development, qi 
manufacturing test. "Products" includes complex products with that requu 
measurements. 

To aid in test development and test re-use, Exec3 provides a standardized 
the test developer. Exec3 relieves the test developer of the tasks presentin 
sequencing tests, displaying and logging results, and interfacing with other 
systems. 

During qualification testing such as Immunity and Environmental, Exec3 
programmatic interface for qualification test supervisor programs. 

During manufacturing, Exec3 provides a common operator interface for m 
helps maximize test productivity. It also provides a consistent software in 
manufacturing systems. 



;c 3 Overview 



iently test" is 
lion testing, and 
any parametric 

are interfaces for 
operator interface, 
anufacturing 

'ides a consistent 



iple products, and 
ace to other 



Agilent Technologies 



5 



Overview 



Exec3 is a 32-bit Windows NT application. It's graphical user interface allows the3uber to select 
a specific product model to be tested, enter configuration information, select and efjjt: a test 
procedure, start testing and control test execution (pause, continue, repeat. . .), and jjfjpw the test 
results. \\ 

Exec3 has well-defined COM (Component Object Model) interfaces to test softw^ and Exec3 
plug-ins. Test software is the code components provided by a test developer to teqjijt specific 
product. This includes tests, test procedures, and test system drivers. Exec3 plug-lmis are code 
components that allow Exec3 to be interfaced to other systems, such as a database^ equipment 



calibration verification system. Test software and plug-in code is contained in DL$i 
Link Library) files, so they can be developed and delivered independently. 
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In addition to the test software and plug-in interfaces, Exec3 exposes an ActiveX interface 
for controlling it. This allows testing to be initiated and monitored from other projajtbrns. 

Exec3 test software is most easily developed using Visual Basic. Exec3's COM irjlerface 
includes an object model that aids in test and procedure organization. It encourag Axirameter- 
driven test routines, which aids in re-use. ; J j 
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Design Philosophy 

Design Objectives: : ■ | 

Exec3 design choices were made with these goals in mind.. jj| 

• Run on readily available computer platforms that supports interfaces tdfeir future products 
(Intel-based PCs, not Series 300) | f 

• Run on a supported, standard, preferred, easily networked, and powerfu^joperating system 
(Windows NT, not RMB) || 

• Allow test development in a language that is not obsolete, and is the m$j|t productive 
language for most engineers (Visual Basic, not RMB) ; j; } 

• Continue to use and evolve the useful features of Exec II. These featutt include parameter- 
driven test code, the procedure/sequence file, ajueraichyof prpcedure/ll^datapoint, 
line/customer/marginal specification limits, dynamic loading of test soi|ware. 

• Allow complex test procedures to be constructed using a standard prog|i|nming language. 
This means using the Visual Basic for procedure file FOR NEXT loopM and not inventing a 
new language. ki 

• Have modular interconnections to other systems, such as a test results <j||abase, Division 
Calibration Administration and Tracking System (DCATS), and unkno&i future systems. 

• Easily allow automatic/remote control of Exec from another program, s|iih as manufacturing 
process controller, environmental test profile controller, etc. % ! 

i"! 'i: 

• Keep the core simple enough to be developed in a few months. Define [Mogrammatic 
interfaces rich enough to allow future extensions that maintain compatibility. 

Other test executives are available, but none that come close enough to thei|iiik>ve requirements 
and goals. ! i | 

What it is not: If 

These are some things you might expect in a test executive, but are not in £j$|fec3 : 

• Exec3 won't test multiple devices at once. However, automatic sequential testing of multiple 
devices can be accomplished by another program that controls Exec3. ipso, the test software 



interface is designed so a future Exec could do simultaneous testing of i|iiiltiple devices. 

Exec3 does not include any test equipment drivers. |; | 

Exec3 is not compatible with Exec II test software and procedure files. j;| j 

Exec3 does not include these Exec II features: auditing/sampling plan, $tfays of data, plotting 
of results. ;!; ! 

Exec3 does not include things like a test results database, equipment calibration checking, or 
environmental chamber control software. However, these items can interface with Exec3 
through plug-ins. .|j 
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Definitions 

Procedure 



Test 



An ordered list, sequence, or script, of Tests to be run. For each t&j&Jt, the 
procedure includes a list of Measurements and Datapoints, which3(i{iclude 
parameters that are passed to the test Procedures have names lik||jtTum-on", 
"Final Sales", and '•Environmental". Exec3 "runs" a procedure. Jpec3 views 
procedures as input data, not code. !'!| 

A group of measurements in a procedure that share the same test ijjjfeorithrn, and 
so the same test software code. Tests have names like "Amplitude|Accuracy", 
"Harmonic Distortion". To run a procedure, Exec3 repeatedly calj||a Test for 
each Measurement and Datapoint. To Exec3, tests are code — notpkta. 

Measurement A configuration or setup for a Test. Tests are parameter-driven, $$1 tests get 
their parameters from a Measurement. Measurements have name'i-Jike 
"Range=10V;Freq= 100kHz" or "Harmonic=3". Exec3 views measurements as 
data to be passed to a test. i ij i 

Datapoint A sub-set of a Measurement, containing additional parameters thaWelect a 



result when one measurement generates multiple results. Datapoij 
names like "Channel^! " or "Peak" 



Result 



Datapoint Result. A single measured value, resulting from runnir^jone 
Measurement of a Test, and extracting a value specified by a Datmjpint. Each 
Result is compared to a Spec and to determine pass or fail. Resuljljare the 
output of running tests. 



have 



lis includes 
Datapoints. 



Test Software The software that must be added to Exec3 to test a ModelFamily. $P 
Tests containing test code, Specs, Procedures of Measurements 
Test Software also encapsulates the Dut and the Test System. Tes$j;j|oftware is 
usually delivered in one or more DLL files. 

Spec Specification or test limits. Results are compared to Specs. Execfl |inderstand 

Specs that are numeric limits, String match, or Boolean pass/fail, '^fumeric 
limits can include up to 3 pairs of upper/lower of limit values: marginal limits, 
production or line limits, and customer limits. i % 

Notice the hierarchical relationship between Procedure, Tests, Measurement, Dataj&jint, 
Datapoint Result. If you are familiar with Exec II's hierarchy, the Measurement isjjfrbw. It was 
created to formally handle the multiple results from one physical measurement. Itjpould 



simplify test code by eliminating the need for MEAS_BLOCKD and FNSame_asJj&pt( ). 
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The screen from the Exec3 application is show above. The "tape recorder" 
are used to control testing. From left to right they are Abort, re-start test, r4j> 
pause, run, skip measurement, skip test. 

The bottom of the screen is a Windows Explorer-like user interface. The p; 
a hierarchy of tests, measurements, and datapoints. Colored icons indicate 
and not yet tested. Hie Pass/Fail icon for the procedure is a summary of al|l 
taking precedence. The right side shows a spreadsheet-like view of test resell 
sorted by clicking on the top column. 

The bottom right graph functions as a progress bar. Its length represents 
The gray horizontal lines represent normalized upper and lower specificatii 
datapoint results in a colored vertical line whose length is proportional to 
spec, and whose color is coded for pass/fail/marginal. 
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Ji Start measurement, 
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ec 3 Programme 



The user can create a "User Procedure" that is a sub-set of a standard test procedural 
the "Select" radio button in "Run All, Marg Fail, Select" adds checkboxes to each 
procedure. pi 






Guide 



Clicking 
in the 



B- 0# AmpfaudeAccuacy Tett 

gj £3# Range-5Vp;Freq*1kHz 

{ © ~B® Range«5vp;Fieq-100kHz 
B- -H® H anionic Distortion Test 

B® Rang«-5Vp; Harmonic-2 

Dim checkboxes indicate that some of the lower-level items are checks and some z 1j not 
checked. The user procedure selections can be saved to a file. [ 

[ 

Menu Items ij 
File j 

Open Test Results.. . opens a comma-separated-value (CSV) results file. Res 
into grid on the right side of the screen, and can be compared to current re 
basis for a re-test of "Marg/Fail" datapoints. 

Open User Procedure... opens a previously saved user procedure file. 

Save User Procedure... opens a previously saved user procedure file. 

Print... opens a previously saved user procedure file. 

ModelFamily 

Displays a list of model families that can be tested. Selecting a new model f; 
current test software and loads the new test software. 





are loaded 
, or be the 



I unloads the 



Dut 

Displays a screen for entry of DUT model, serial number, options, etc. Changii 
clears the test results. 

Settings 

Displays a screen for viewing and changing Exec settings. These include: O 
Comments, Temperature, Humidity, Qualification test, Region, Production: 
specifications. 
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Tools 

Add Note... allows the operator to insert a note in the test results log. 

Test System Devices... Displays a spreadsheet with a row for each device in the test system. 
The operator can enter device information such as Maintenance Number, Service Due 
Date, and Address. Clicking the "Save" button will write this information to a file which 
will be loaded each time Exec is started. 

Test System... Displays the user interface for the current test system. What appears when 
this is clicked depends on the currently loaded test system software. 

<Plug-In 1>.... Displays the user interface for the first plug-in loaded. The name of this 
menu item and what appears when it is clicked depends on the plug-in. There may be 
several plug-ins. 



Test Results Files 

Exec saves test results into comma-separated-value (CSV) result files. These files can be opened 
by Exec for review or printing. When opening a file of previous results, Exec can update the 
colored "pass/fail" icons in the left side of the screen. This feature makes it easy to re-run only 
the measurements that failed earlier (in other words, run a Marg/Fail procedure). 

The CSV files can be also be opened spreadsheet program like Excel for analysis. 

Exec writes measurement results to the file at the end of a test. Aborted test won't normally 
generate results. 

File Locations and File Names 

Executive stores test results files in a separate directory for each Dut model number. These Dut 
Model directories are located in a directory you specify in the ExecConfig.ini configuration file 
(see Administering Exec3). This directory can be a shared network drive. 

Exec forms the results file name using the procedure name and the procedure start time/date. 
Exec creates a Results file subdirectory for each Serial number (or Avid). 

For example, for model E1438A, Serial number "US3800123", procedure "Final", started on 
November 30 at 1 :45:59 PM, the subdirectory and file name would be: 

E1438A\US3 800 123 \Final_113 0_134 5 59 . csv 

This subdirectory will be located in the directory specified by the ResultsDir= line of the 
ExecConfig.ini file. 

File Format 

See the "Exec Details" section of this document. 
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Writing Test Software 



This section describes how you, a test software developer, will write tests for production, 
environmental qualification, or other special test needs. The test software developer is typically a 
New Product Introduction Engineer, Production Engineer, or Technician. It is assumed that you 
are familiar with the latest version of Microsoft Visual Basic, collections, the implements 
keyword, ActiveX components, and object-oriented programming. Test Software can be 
developed using other COM/ ActiveX compatible languages, but that is beyond the scope of this 
document. 

The Exec environment includes two "Wizards" that can help you write Test Software. These 
wizards are described at the end of this section. If you plan use the Wizards, you should read all 
of this section so you understand the code the wizards generate. 



Overview 

Before looking at example code, you should understand the Procedure-Test-Measurement- 
Datapoint hierarchy, the order in which test software is executed, and the files in a typical 
TestS w project. 
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Procedure Hierarchy 

Every test executive, it seems, has a different approach to structuring test 
elements. Figure 1 diagrams the ModelFamily-Procedure-Tcst-Measurem< 
hierarchy used by Exec 3. 
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1 




TMM 




Tnt2 




Tart 3 





Tmi n 



Figure 1: Tcst-Measurement-DatoPoint Hierarchy 

Components of this architecture are described next. 

Product Model Family: The top level of this diagram is the Product M< 
corresponds to a Test Software DLL file you create. You can develop on 
file to test a family of specific model numbers, like E1434A/B/C, so this 1 
Family." Your Test Software (or TestSw) DLL contains Procedures, Te 
entire TestSw package is typically one Visual Basic project, and can kept 

Procedure: An ordered list, sequence, or script, of Tests to be run. For e 
includes a list of Measurements and Datapoints. Procedures have names 
Sales", and "Environmental". Exec3 "runs" a procedure. Your test softw; 
procedures, but the test operator can select a subset of a procedure to run. 
procedures as input data, not code. A procedure is transferred from the T 
as a structure of COM objects. You define a procedure by writing code 
COM objects. 
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Test: A group of measurements in a procedure that share the same test algorithm, 
same test software code. Tests have names like "Amplitude Accuracy", "HarmonK 
To run a procedure, Exec3 repeatedly calls a Test for each Measurement and Dataj 
Exec3, tests are code - not data. You implement a test by adding a Visual Basic ~ 
to your TestSw project. The code you put in this class should implement the test 
parameter-driven way. Then, in the procedure definition code, you insert code to $ 
instance of this class and add it to the procedure. 

Measurement (Meas): A configuration or setup for a Test. Each measurement 
can have different setup or configuration parameters. Tests are parameter-driven^ 
their parameters from a Measurement. Measurements have names like 
"Range= 1 0 V;Freq= 1 00kHz" or "Harmonic=3". Exec3 views measurements as dat 
from a Procedure to a Test. You define a Measurement for a Test by creating a n^ 
object and adding it to a Test in a Procedure. The CMeas class is already defined 
you need only to create and use Meas objects. 

"Measurement" is also a phase of test execution. During the measurement phase 
execution, the measurement is started but data is not collected: this allows for mul 
be configured and triggered together. * 

DataPoint (Dp): A sub-set of a Measurement, containing additional parameters 
result when one measurement generates multiple results. Datapoints have names 
"Channel= 1 " or "Peak". One Measurement may return one or more Dps as logi( 
to you. Some examples of multiple Dps for a measurement: minimum and maxim| 
spectrum analyzer sweep, or each channel of device. If a Measurement has only 
be blank. 

"Datapoint" is also a phase of test execution. This is where the data is harvested. | \ ft doesn't 
make sense to separate the Measurement phase form the Dp harvesting phase, yov|pjan write your 
test to do the entire measurement during this phase. 
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Writing Test Software 



Order of TestSw Execution 

Figure 2 - Order of TestSw Execution, shows the order in which Exec will 
your Test Software. 
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Figure 2 - Order of TestSw Execution 

In this figure, the outer polygon represents Exec's code, and the middle bojlfepresents your 
TestSw DLL code. The left portion shows three methods you must provicifejin a class named 
"CTestSw." The middle of this box shows an example Test class, named 'fjGiTestFlatness." 
Usually there are more Tests, but this diagram shows only one. Each test mist have the methods 
shown. If 

if It: 

:ec will call them. 



The methods in this figure are arranged from left to right, in the order that 
The following describes each phase of the sequence. 

1. Exec calls TestSwInit This occurs immediately after Exec loads yoinjjjfestSw DLL. Exec 
calls TestSwInit to get information from your test software, including 
tested, a list of procedure names, and references to an objects represent 
system. 



Exec calls ProcExpand when the operator selects a procedure from th$ 
Your ProcExpand method builds the structure of Test, Meas, and Dp o 
details of the Procedure. When this is returned to Exec, it displays Pn 

When the operator starts a procedure, Exec will call Proclnit in your lj 
code should initialize test system I/O, etc. 
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4. Exec calls the Testlnit method in the first test. In this method, you may want j|| preset the 
test system, preset the DUT, and do setups that are common for all measxiremejMs in the test. 
Pass parameters for this method include a reference to the Dut object, which h£j|properties 
for Address, Slot, etc. i ? \ 

5 Exec enters a loop to call the Measlnit, ResultsGet, and MeasDelnit methodsjijif the test, 
once for each Measurement. The Measlnit pass parameters include one Measj^jyect. This 
Meas object is one you created and added to the Procedure in your ProcExpan| method. The 
Meas object can include many Parameter objects, which define the configuratip for the 
measurement. So, your code in the Measlnit method will typically use the val(pfc of these 
Measurement Parameters to configure the Test System and Dut. 



::4 



6. Exec calls ResultsGet in your test, and passes it a collection of Datapoints forfj$je 
Measurements. These Dp objects are ones you created and added to the Procejdtfre in your 
ProcExpand method. For each Dp, Exec expects your ResultsGet method to "Ml back" to 
Exec's ResultPost method. The pass parameters you send to ResultPost inclu|| a measured 
datapoint value you want Exec to compare to specification. I ! | 

7. Exec calls MeasDelnit before calling Measlnit for the next Measurement. t j 

8. When all Measurements have been run, Exec calls TestDelnit before moving p the next test. 

9. Not shown in the figure are these Delnit methods: ProcDelnit will be called vp;n the 
procedure finishes or is aborted, ProcCollapse will be called before changing M another 
procedure, and TestSwDelnit will be called before unloading the TestSw. \l j 



Test Software Project Files 'i ! 

As a minimum, your TestSw Visual Basic project will contain these class files. T^e VB 
project files are compiled into the TestSw DLL file. The names below are for an e^mple 
TestSw project to test models E1234A/B. It is based on the files in the j 
Exec\TestSw\TestSwExample, except "Example" is replaced with "El 234". As ejgflained in the 
"Exec 3 Details" section of this document, class module names start with "C" andljjre saved in a 

file name that does not include the "C" prefix. I ' j 

\'- 1 ■ 

CTestsw (TestSw. cla) J j; 



This class is where the TestSwInit, ProcExpand, and Proclnit methods are implenpfited. This 
class is the initial interface between your TestSw and Exec, so the module name life be 
"CTestSw", and this module must implement the ITestSw interface defined by Ex&|. 

CDutE1234 (DutE1234.cls) ;: j : 

CTestSystemE1234 (TestSystemE1234 . els) v| 

These classes represent your Dut and TestSystem. Your code should use the VB Elements 
keyword so your classes are derived from the IDut and ITestSystem class defined \$f Exec. 



CTestAmplitude Accuracy (TestAmplitudeAccuracy . els) 

CTeatFlatness (Test Flatness . els) U f 

I «'. !; 

These are examples of 2 tests. ' j 



FFT ( FFTMath . bas ) 



This is an example of an additional file that is specific to your test software, and uj^ijlelated to 
Exec. !? T 

4i- 
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